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ABSTRACT 

In this report of the final ev^aluation of the Las 
Cruces (New Mexico) Sustained Primary Program for Bilingual Students 
(funded under Title III of the Elementary and Secondary Education 
Act) , the major findings for the academic years of 1967-8, 68-9, and 
69-70 are cited following a program description in terms of schools, 
students, teachers, class size, classrooms and _ treatments , and 
objectives for each year. As reported, K-3 bilingual children in 4 
public elementary schools that tended to be homogeneous with regard 
to the children’s cultural and socioeconomic backgrounds were placed 
in 1 of 3 instructional settings; (1) an experimental English program 
where only English was used as an instructional language, (2) an 
experimental Spanish/ English program where both languages were used, 
and (3) a control program. The report discusses the program's 
effectiveness in terms of such factors as Spanish vs. English 
instruction, children’s intellectual development and self-concept, 
parental involvement, and the children’s bicultiiral interaction. 
Although ’’results of the K-3 experiment still are. inconclusive , ” it 
is indicated that the program is providing" ... a very valuable set of 
learning experiences in both the cognitive and affective domains," 
Also included in the report is a post-program evaluation, completed 
in the fall of 1970, to examine the effectiveness of the summer 
session experience as measured by the Metropolitan Achievement Test, 
IQ tables suromarize the significant differences and the analyses 
proper, which indicate that the summer sessions appear to have a 
beneficial effect on achievement, <NQ) 
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INTRODUCTION 

This is the final evaluation of the Sustained Primary Program for 
Bilingual Students* It sunmarizes the major findings of the annual 
evaluations for the ^ ’ademic years 67 “68, f 69-70 and presents a 

fall 70-71 post^-program evaluation of academic achievement* 

The purpose of the "bilingual program" is to " increase the achieve-” 
ment levels of Spanish^speaking students through a sustained kindergarten 
through third grade language arts prograin^ dual language Inis traction and 
parent involvement*" (K«3 Progress Report^ jD, 12) 

This study examines the academic and intellectual achiievernent of 
children in three instructional settings, an Experimental English (E) 
program, an Experimental Spanish/English (SE) program^ and the Control 
program (C) . These programs are more fully described in the Title VII 
Evaluation Report , 1970* 

The major difference between the Experimental English and the 
Experimental Spanish/English programs is that only English is utilized 
as an instructional language in the EKparimental English program and 
both English and Spanish are utilized in the Experimental Spanish/English 
program* 



POPULATION 

Schools , Students in the research sample ware located in four Las 
Cruces Public Elementary Schools; Bradley r Lucero, Me si 11a Md Washington 
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liable 1 comparers the four schools with regard to the incidence of 
children from low incbitie families and various cultural backgrounds^ 
Inspection reveals these schools tend to be rather homogeneous with re- 
gard to these variables. The school showing the greatest deviation from 
homogeneity is Washington, 

Students , The research population appeared to be representative of 
the population within the research school but was not representative of 
the entire school district population. Probably in future groups more 
non-Spanish-speaking children should be incorporated into the Experi- 
mental Spanish/English program. However, since the program is volimtary 
and the nun^tr of non-Spanish-speaking children in the research schools 
is very small^ it may be difficult to find a sufficient nuinber of parents 
willing to place their children in the Spanish/English part of the pro- 
gram. 

It must be acknowledged, however, that there has been a large number 
of parents contacting public school personnel to request that their 
children be placed in the program. Unfortunately it has not been possible 
to acoortunodate these requests nor has it been possible to record the 
cultural backgrounds of these people. 

Teachers p Teachers in the various groups were quite, different with 
regard to cultural, language and experimental backgrounds. The Experi- 
mental group teachers tend to be bilingual^ (English and Spanish), have 
a Spanish-i^erican or Mexican-American cultural heritage, and be less 
experienced in teaching. The Control group teachers tend to be monolingual. 
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Table 1 



Description of Student Population 
at the Four Project Schools 



School 


Low 

Income 


Spanish 

Surnaine 


Non-Spani sh 
Surnaine 


Bradley 


40.9% 


99% 


00% 


Lucero 


49. a% 


97% 


3% 


Mesilla 


41.0% 


97% 


3% 


Washington 


39.9% 


79% 


21% 
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have a "main stream" cultural heritage , and be more experienced in 
teaching - 

In order to make a more precise evaluation of the effectiveness of 
the program, this variable should be controlled. Specif ically. Control 
teachers should be selected to match the experimental group teachers to 
relevant experience and training variables , The Control group teachers 
are selected by the principals with the consent of the teacher. One 
problem in securing Control group teachers, however, has been the re- 
luctance of these teachers to relinquish the classroom time required for 
testing. As the number of variables measured increases, the magnitude 
of this problem will increase. Much thought and effort is currently, being 
devoted to ways in which the amount of testing time required of the tea- 
cher and students can be reduced to a minimum. 

Class size . Generally class sise was approximately equal for the 
three groups with about 25 students per classroom. 

Classrooms and Treatments , Classrooms assigned to the Experimental 
English Treatment were located in Bradley and Washington schools? .those 
assigned to the Experimental Spanish/English program were located. in 
Mesilla and Lucero schools* The Control classrooms were located in all 
four schools , 



OBJECTIVES 



The stated objeGtives of the bilingual project have been expanded 



as the program progressed. 
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First Yearns Objectives 

To increase the aGhievement level of Spanish-speaking pupils 
through the use of a sustained K-3 program- 

II* To determine whether Spanish^-speaking pupils achieve at a higher 
level in a program that utilizes instruction in both Spanish and 
English or in a program utilizing English only. 

III. To involve the parents of the Spanish-speaking students in the 
educational program as advisors and learners thus enriching 
the home environment of the child* 

IV. To determine whether a 12-month school year (200 school days) 
with short vacation periods spread evenly throughout the year 
will serve the learner better than the ISO day regular term 
with its three month vacation. 

Second Year*s Objectives 

I. To increase the achievement level of Spanish-speaking pupils 
through the use of a sustained K-3 program. 

II* To determine whether Spanish-speaking pupils achieve at a higher 
level in a program that utilizes instruction in both Spanish and 
English, or in a program utilizing English only. 

III. To involve the parents of the Spanish-speaking students in the 
educational program as advisors and learners, thus enriching 
the home environment of the child. 

IV. To determine whether a twelve month school year (200 school 
days) will serve the learner better than the regular school year 
(180 school days) . 
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V« To increase the measurable mental abilities of children who 
have Spanish cultural/linguistic backgrounds » 

VI ^ To help children develop positive feelings of self-worth. 

VII p To help children develop skills for bilingual—bicultural 
interaction, 

VIII, To construct a school curriculum that utilizes the culture 
and language of Spanish background pupils. 

Third Year*s Objectives 

Instructional Outcomes Cognitive Domain s 

I, To increase edueationa!) achievement of Spanish-speaking children 
who have low functional levels in the English language, 

IX* To increase the measurable mental abilities of children who have 
Spanish cultural/linguistic backgrounds. 

Instructional Outcomes — Affective Domain; . ' 

III, To help children develop positive feelings of self-worth, 

IV. To help children develop the desire and the skills for meaning- 
ful bicultural interaction* 

Instructional Outcomes - Parent/School Relationships; 

V* To improve home/s chool relationships so that pare ^s may become 
more directly involved in the establishment of educational goals 
for themselves and their children. 

Methodological Features: 

VI. To construct a school curriculum which utilizes the culture and 
the language of Spanish-speaking pupils. 
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VII, To provide differentiated learning activities in order that 
children may experience success in both the cognitive and 
affective domains • 

VIII. To provide continuous educational learning experience so that 
no time is lost in review or re-teaching via a suiraner program. 

Inspection of the objectives indicates that they grew to include 
learning in the affective domain and the development of methodological 
features. 



RESULTS 

Academic Achievement 

Academic achievement was evaluated primarily by means of the Metro- 
politan Achievement Test. This is an English language instrument which 
in no way measures fluency in the Spanish language. In fact, those 
students being instructed to a significant degree in Spanish may be 
handicapped in their ability to perform on this test since a considerable 
portion of classroom time is being spent in Spanish language instruction 
and thus English language usage is not as extensively covered as it is 
in the traditional classroom* 

Also, if the student is exposed to a curriculiam with a high cultural 
and self awareness content, he may not initially perform as wall in the 
academic areas as the student who is exposed to the traditional curriculum. 

The assumption of the Las Cruces Pi^lic Schools Bilingual Project 
is that a program emphasizing cultural and self-awareness along with 
developing the basic language ability of the child may initially alow 
the child* s acquisition of 'the academic skills. However, by emphasizing 
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these factors it is felt that the child will develop a more positive 
self image and a stronger foundation in communication skills. Once these 
skills are acquired, the student can then excel in the academic subject 
areas . 

Thus, at the first and second grade level, one should expect the 
experimental group students to perform less well than the Control stu- 
dents in the general academic areas. However, in the intermediate grades, 
third and fourth, the experimental group students should begin to catch 
up and surpass the Control students. Finally, if the project is succass- 
ful, the experimental groups* performances in the traditional academic 
areas should surpass the Control groups in the last two elementary grades. 

Because of this it is difficult to make clear-cut statements re- 
garding the long-term effectiveness of the bilingual program until stu- 
dents complete the sixth grade. In fact, it could be argued that com-- 
plete program evaluation requires that students be followed through their 
entire academic careers. 

Program Effectiveness 

The results seem to conform to the expectation that Control group 
students would show greater achievement in the first two grades and at 
the third grade level differences between groups would disappear. 

Summer Program . The surraner sessions appear to have a beneficial 
effect on achievement. 

Spanish Versus English Instruction . The results with regard to 
Experimental Engl^ish versus Experimental Spanish/English programs, however. 
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are not clear and a meaningful interpretation of the data is difficult.. 
However, it appears that dual language instruction in Spanish and English 
usage does not permanently retard academic growth. The Spanish/English 
students acquired both Spanish language and English language skills and 
at the end of the third grade did not show a deficit in the other academic 
skills. 

Intellectual Development 

Intellectual development was evaluated by means of the California 
Test of Mental Maturity - Short Form. There v/are no consistent differ- 
ences in performance on this test between the various groups. Thus, it 
would appear that the experiniental program did not have a measurable 
differential effect on the intellectual development of students. 

Parental Involvement and attitude Toward Education 

The data suggest that parents of children in the experimental pro- 
grams tend to have a more positive attitude toward education and the 
progrOTi than do Control group parents. Also, experimental group parents 
seem to make more contacts with the school - 
Self-Concept 

There is no data regarding tiie relative self-concepts of the chil- 
dren in the bilingual project which can be meaningfully interpreted. How- 
ever, work has begun on the development of a procedure for evaluating 
this dimension of student functioning. 

Bicultural Interaction 

What applies to self-concept also applies to bicultural interaction. 
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Methodological Features 



Wliile there is no "hard data" regarding objective^ VI, VII ^ and 
VIII of the third year's evaluation, it is the impression of this and 
earlier evaluators, the auditors and a mmber of on site visitors that 
the progran is meeting these objectives* 
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CONCLUSION 

The results of the K--3 experiment are still at this point incon-^ 
elusive- However^ formal evaluation, auditors* reports and informal 
reports of classroom visitors indicate that the program is providing 
Sp^ish^spe^ing children in the Las Cruces area with a very valuable 
set of learning experiences in both the cognitive and affective domains. 

By the end of the third grade year all groups are essentially 
equal in achievement. In addition, the Experimental Spanish/English 
group has developed Spanish language skills that have not yet been 
measured. It is significant that children learning in two languages 
achieve equally as well as children taught in one language- Further, 
time spent with Spanish language instruction does not appear to cause 
the Experimental Spanish-English group to peimianently fall behind the 
Control or EKperimental English groups. 

Evaluation of such a progrOTi is a complex, long term task and in- 
strumentation to accomplish much of it is not commercially available. 
Thus, the evaluation depends upon the development of a set of appropriate 
tests. This is well underway in the Las Cruces Project. 
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APPENDIX 



Post Program 
Evaluation 
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1 \ final partial evaluation of the K-3 program was perfonned in the 
of 1970. Academic achievament of children entering the third and 
fourth grades was examined via the Metropolitan Academic Achievement of 
children entering tiie third and fourth grades was eKamined via the 
Metropolitan Achievei nt Test» The primary purpose of this evaluation 
was to examine the effectiveness of the sunmier session experience. The 
results of this analysis are consistent with those of earlier evaluations. 

A summary of significant differences is presented in Table 2. The analyses 
proper are sx^nmari^ed in Tables 3 through 10. 




i5 



13 



ta 

Ui 



o 



o 

o 

g. 

Q 



c+ 

•-i 

ct* 

Hi 

Q 

P 

P 

H 

O 

r 

cn 

dn 

hS 

O 

o 

B 




» M 
»-3 O 

w »:a o 

D3 O 

M 



1-3 

dd 






o 




a 


1 


pn 


o 


=<3 




w 


M 




Di, 




i-3 


c5‘ 




D3 











O 

ERIC 



16 



TABIE i 



TEST 15 

ANALYSIS OF PERFORMANCE 

FOR 2nd In 69 

ON MAT 

Word Knowledge 

Administered Fall 70 









MEANS, STANDARD 


DEVIATIONS AND NUMERS OF SUBJECTS 










Treatment Groups 










Experimental 










EE Spanish/E 


Ingliah 


Control 






M 


44.60 


38.26 


42.90 




Boys 


SD 


8.44 


7. SO 


7.20 






N 


20 


23 


30 






M 


46.38 


42.60 ■ 


45-48 




Girls 


SD 


7.04 


7.05 


6 . 58 






N 


29 


20 


31 




Combined 


M 


45.63 


40.28 


44.21 






N 


49 


43 


61 








ANALYSIS OF 


^ VARIANCE SUMMARY 






Source of 




Sum of 


Degrees of 


Means 




Variance 




Squares 


Freedom 


Squares F-Ratio 


A 


“ Sax 




311.31 


1 


311.31 ■ 5.6l-i«- 


B 


- Treatment 


680.74 


2 


340.37 6.14* 


S 


X T 




41.76 


2 


20.88 0.3s 


Error 




8155.31 


147 


55.48 



SUMMARY 



The Experimental English group and the Control group 
were superior to the Experimental Spaniah/English group# 
There was no significant difference between the Control 

group and the Experimental English group. 
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TABLE k 
TEST 15 

AMAIZSIS OF PERFORl^ANCE 

FOR 2nd in 69 

ON mT 

Word Dlscrljiilnation 
Administered Fall 7Q 



mkm, STANDARD DEVIATIONS AND NIMBHIS OF SUBJECTS 
Treatment Groups 
Experimental 

^ Span! sh/Engli sh C ont r o 1 





M 


47.10 


45-35 


44.37 


Boys 


SD 


9. SI 


8.SS 


9.70 


N 


20 


23 


30. 




M 


50.97 


49.25 


49.06 


Girls 


SD 


7.93 


5.77 


7.S2 




N 


29 


20 


31 


Combined 


M 


49.39 


47.16 


46.75 




N 


49 


43 


61 





ANAIZSIS 


OF VARIANCE SUMMARY 






Source of 


Sum of 


Degrees of 


Mean 




Variance 


Squares 


Freedom 


Squares 


F-Ratio 


A -- Sex 


633.21 


1 


63S.21 


S.57- 


B - Treatment 


143.39 


2 


71.69 


J.96 


S X T 


5-10 


2 


2.55 


0.03 


Error 


10944.61 


147 


74.45 





■ SmMARY 




Thera were no significant differences betwe^ treatment 
groups. The girls performed significantly better than the 
boys . 

. 18 ■ 



TABLE 5 
TEST 15 

ANALYSIS OF PERFORMANCE 
FOR 2 nd in 69 ■ 

ON MAT 

Reading 

Administered Fall 70 



l^IEANS, STANDARD DEVIATIONS AND NXDEERS OF SUBJECTS 
Treatment Groups 
Experimental 

EE Spaniah/English Control 





M 


43.80 


38.26 


40,67 




Boys 


SD 


8.76 


8.93 


8.99 




N 


20 


23 


30 






M 


48.55 


41.80 


45.23 




Girls 


SD 


7.88 


8.41 


6.94 






N 


29 


20 


31 




Combined 


M 


46.61 


39.91 


42.99 






N 


49 


43 


61 








ANALYSIS OF VARIANCE SUMMARj^ 






Source of 




Sum of 


Degrees of 


Mean 




Variance 




Squares 


Freedom 


Squares 


F-Ratio 


A “ Sex 




678.15 


1 


678.15 


9.49'''= 


B Treatment 




931.33 


2 


465.67 


6.5,2'-- 


S X T 




10.10 


2 


5.05 


0.07 


Error 




10500.12 


147 . 


71.43 





SUMMARY 



The Ib^erimantal English group was superior to th'.- Experimental 
Spanish/English group. The girls performed significantly bett«.r 
than the boys . 
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TABLE 6 
TEST #15 

ANALTSIS OF PERFORMAIMCE 

FO R 2nd In '69 

ON MT 

Arithmetic Conoepts & Skills 
Administered Fall 70 



MEAl'JSj STANDARD DEVIATIONS AND NUlylBERS OF SUBJECTS 
Treatment Groups 









Experimental 








EE 


Span! sh/Eng lish 


Control 




M 


48.25 


39.96 


41.50 


Boys 


SD 


7.94 


8.49 


6 .60 




H 


20 


23 


30 




M 


47.28 


39.85 


41.55 


Girls 


SD 


8.46 


8.06 


7.67 




N 


29 


20 


31 


Combined 


M 


47.68 


39.91 


41.53 




N 


49 


43 


6l 





ANALYSIS 


OF VARIANCE StMlARY 






Source of 
Variance 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Squares 


F-Ratio 


A “ Sex 


4.72 


1 


4.72 


0.07 


B “ Treatment 


1697.24 


2 


848.62 


1^.24-5^ 


S X T 


7.03 


2 


3.51 


0.06 


Error 


9420.23 


147 


64.08 





O 

ERIC 



■SUmiARI 

The Expermental English group "was superior to both the 
E^qperimental Spanlsh/Engliah group and the Control group# 

m 
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TABIE 7 
TEST #15 

ANALXSIS OF PERFOR14AMCE 
FOR Srd in 69 - 70 
ON MA T 

Wn r d_ K n nT-j~| Rd g; r 

Administered 1 1 70 



MEANS ^ STANDARD DEVIATIONS AND NUMERS OF SUBjECTS 
Treatment Groups 
Experimental 









Spanish/English 


Control 




M 


43.25 


43.06 


45.12 


Boys 


SD 


11.84 


7.79 


7.4s 




N 


B 


18 


26 




M 


44.53 


46.23 


41.74 


Girls 


SD 


5.38 


8.82 


6,0a 




N 


15 


22 


23 


Combined 


M 


44.08 


44.80 


43.53 




N 


23 


40 


49 





AWAHSIS 


OF VARIANCE SUMMARY 






Source of 
Variance 


Stm of 
Squares 


Degrees of 
Freedom 


Mean 

Squares 


F-Ratio 


A “ Sex 


3.50 


1 


3,50 


0.06 


B - Treatment 


24.40 


1 


12.20 


0.19 


S X T 


181. 50 


1 


90.7490 


1.44 


Error 


6663.14 


106 


62.86 





. SUMMARY 

Thera were no significant differences. 
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TABLE ft 
TEST #15 

ANALYSIS OF TERFOR14ANCE 

FOR 3 rd in 69-70 

ON MAT 

Vford Pis orirti na t.i nn 
Administered Fall 70 







IfflANS, STAiroARD DEVIATIONS AND MmffiERS OF SUBJECTS 










Treatment Groups 










e r line nt a 1 










EE Spa nlsh /Engli ah 


Control 






M 


4S.75 


43.23 


46.08 




Boya 


SD 


7.07 


5.83 


7.51 






N 


8 


IS 


26 






M 


44.87 


48.68 


45.04 




Girls 


SD 


5.73 


5.70 


6.98 






N 


15 


22 


23 




Combined 


M 


46.22 


46.25 


45.59 






M 


23 


40 


49 








ANAIZSIS OF VARIANCE SUMMARY 






Source of 




Sum of 


Degrees of 


Mean 




Variance 




Sqtiares 


Freedom 


Squares 


F-Ratio 


A — Sex 




0.81 


1 


0.81 


0.02 


B - Treatment 


26.03 


2 


13.01 


0.29 


S X T 




362.37 


2 


181.19 


3.99’'= 


Error 




4804*43 


106 


45.33 












P<.05 










SUMMAm 






There 


ia 


a significant 


interaction between Sex 


and Treatment. 
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TABIE q 
TE.ST #15 

MAIZSIS OF PERFORMANCE 
FOR 3 rd In 69 - 70 

ON I^.T 

Reading 

Administered Fall 70 







MEANS, 


STANDARD DEVIATIONS AND NUMERS 


OF SUBJECTS 








Treatment Groups 










Experimental 








IE 


Spanish/English 


Control 




M 


46.13 


42.22 


44.54 


Boys 


SD 


7.72 


5.82 


6.47 




N 


S 


IS 


26 




M 


44.53 


46.23 


42.52 


Girls 


SD 


5.34 


7.22 


5 . 66 




N 


15 


22 


23 


Combined 


M 


45.09 


44.43 


43.59 




N 


23 


40 


49 





ANALYSIS 


OF VARIANCE SUMMARY 






Source of 


Sum of 


Degrees of 


Mean 




Variance 


Squares 


Freedom 


Squares 


F- Ratio 


A - Sex 


0.44 


1 


0.44 


0.01 


B - Treatment 


52.74 


2 


26,37 


■•> 0,62 


S X T 


180.7473 


. 2 


90.37 


2,14 


Error 


4485 . 80 


106 


42.32 





smmARY 



There were no significant differences. 
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TABLE 10 
TEST #15 

ANAIZSIS OF raRFORMAWCE 
FOR 3rd -In 69 -70 

OM MAT 

Arithmetic Concepts & Skills 
Administered Fall 70 







ME AMR. STANDARD DEVTATIOWS AIMD HUMffilRS OF SUBJECTS 










Treatment Groups 










Experimental 










EE Spanish/English 


Control 






M 


45.00 


44.06 


42.54 




Boys 


SD 


9.06 


8.38 


7.77 




N 


S 


IS 


26 






M 


44.33 


46.45 


42.22 




Girls 


SD 


8.13 


7.66 


S.34 






N 


15 


22 


23 




Combined 


M 


44.56 


45.37 


42.39 






N 


23 


40 


49 








AWAIZSIS 


OF VARIANCE SUMMARY 






Source of 




Sum of 


Degrees of 


Mean 




Variance 




Squares 


Freedoni 


Squares 


F "Ratio 


A - Sex 




5.4431 


1 


5.4431 


0.0783 


B - Treatment 


148.1514 


2 


74.0757 


1.0660 


S X T 




44.9835 


2 


22.4917 


0.3237 


Error 




7366.1172 


106 


69.4917 





SUMIARY 



There were no significant differences. 
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